
High Resolution (HR) 
Target Image T 
(spacial domain) 
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utlize T in its frequency domain representation: perform DFT of T 




Sub-sample target image DFT at rate 
R x , R based on mean sampling rate 
info derived during calibration stage 
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Shift the sub-sampled DFT for each 
region r, by corresponding entry in 
linear shift matrix + offset 



Resulting Fourier Series is generated and 
component images are estimated for each 
of a plurality of overlapping projectors 
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Component images are adjusted by a 
global optimization-->minimize difference 
between sum of the different components 
and the target image 
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recover homographies 
between each projector 
p (1 to K) & the 



camera c: 



pi 



,7 ? 




during this phase 
(boxes 16, 18, 19) 
an initial set of 
component image 
estimates are 
made utilizing info 
taken from 
calibration 




framerbuffer 
Optique R" 
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FIG. 2 
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Convert HR target image T (spatial domain) into freq. domain: 
perform Discrete Fourier Transform (DFT) of T 
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Sample the DFT of target image F^u.v) at sampling rate for each 
component projector posing info from calibration stage-preferably 
done earlier in time, off-line to recover homographies H c 



Shift the sub-sampled DFT for each region, r } by corresponding 
entry in linear shift matrix + the offset for that region 



Generate resultant Fourier Series to estimate component projector 
images for each of a plurality of overlapping projectors 
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OPTIMIZATION: Adjust each estimated component image by minimizing 
difference between sum of the various components and the target 
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Input each optimized, sub-sampled, shifted image into respective projector 




Project image from Projector 1 




Project image from Projector K 











Camera (1 to j) views and records super-resolution region R - info used 
to recover H c p/ between each projector (1 to K) and that camera c y 
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Convert each H c pi into a respective H b j betwn projector and target image ref frame b 
Decompose each into a linear shift matrix representing offsets between respective 
projector and base ref frame b -> that is, for each region r compute approximate 
linear shift and corresponding offset for that region 
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FIG. 3 



Geometric Transformation 
of framebuffer information 
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Camera 1 



Framebuffer 3 ->1 



C1^P3 



Framebuffer 2 ->1 

C1^P2 



Framebuffer 1 ->1 

C1^P1 
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Camera 2 



Framebuffer 3 ^> 2 

C2^P3 



Framebuffer 2 -> 2 

C2^P2 



Framebuffer 1 -> 2 



C2^P1 



i _ j 
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Perform 
Calibration. 
Find 

homographies 

C1^P3 
C<|Hp2 
C1^P1 
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Image 
Processing 
(comparator) 



Predicted lmage 1 
at time t 



Capture/observe 
the lmage 1 /c 1 
at time t 



£ 
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Predicted 
Geometric 
View in 
Camera 1 




£ 
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C(0 2 

Predicted 
Geometric 
View in 
Camera 2 




Camera 1 



Perform 
Calibration. 
Find 

homographies 

C2^P3 

C2 H P2 

C2^P1 
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Image 
Processing 
(comparator) 



Predicted Image 2 
at time t 



Display 
Surface(s) 



Capture/observe the 
lmage 2 I c 2 
at time t 




Camera 2 



-NO: await sampling interval- 




4 pixels from 
component 
projector PI 



no 

The overlapping 
region gives rise 
to virtual pixels 



4 pixels from 
component 
projector P2 



FIG. 5a 




FIG. 5b 



The HR region 
(R) defined by 
overlapping pixels 



A pixel in 
the R frame 

Projector P2*s 
view frustum 
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FIG. 6 
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jTarget image 



Component prqjectolrS- 



cl, c2... cN : 1 



Gal ibration ofmti Itu pr aj e.cA nr d 
Homograph ies a Shift matrices co 
■ ^toleramieivalue • :> 1 : ; :•••;;•'•;•> 


splay system 
mputed given 
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Component Image Estimation: For each 
projector. Sample & Shift given high- J v 
resolution image using corresponding Shift 
Matrices to derive component images. 
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Jin itial Component Images! 



Global Optimization of component images 
using Levenberg-Marquardt technique 
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Optimized component images [y] ct . [g] c2 . . [ij]^ j 
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FIG. 7 




FIG. 8 



